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Create a 



Panorama - Microsoft Internet Explorer 
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Upload the images you want to use for your panorama 
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After the images are uploaded, 
click here! 

Create Panorama 
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Panorama result - Microsoft Internet Explorer 
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Sell stuff here! 



Here is your free panoramic image! 
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Click here to order a full resolution glossy print 
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RECEIVE IMAGES OVER NETWORK~H" 



200 



DETERMINE POSITION OF SEGMENT CORRESPOND- 
ING TO EACH IMAGE RELATIVE TO POSITION OF 
SEGMENTS CORRESPONDING TO OTHER IMAGES 



CORRECT PERSPECTIVE DISTORTION 
IN ALL RELATIVE TO CENTRAL IMAGE 



I 



SET PIXELS OF ALL IMAGES VISIBLE EVERYWHERE | - 



SET CURRENT IMAGE TO FIRST IMAGE 



T 



-202 

-204 
-206 
-208 
-210 



SET CURRENT IMAGE TO NEXT AFTER CURRENT 
IMAGE AND REFERENCE IMAGE TO FIRST IMAGE 



DETERMINE OUTLINE OF PANORAMIC IMAGE FORMED BY 

ALIGNING THE CURRENT AND REFERENCE IMAGES 
BASED ON THE RELATIVE POSITION OF THE SEGMENT 
CORRESPONDING TO THE CURRENT IMAGE 



212 



DETERMINE LINE DIVIDING PANORAMIC OUTLINE (I.E., 
LONGEST LINE JOINING POINTS WHERE BORDERS OF 
CURRENT IMAGE AND REFERENCE IMAGE INTERSECT) 



S 



214 



DIVIDE PANORAMIC OUTLINE INTO 
TWO SECTIONS BASED ON LINE 



216 



218 



DETERMINE WHICH OF THE TWO SECTIONS 
HAS LESS OF THE CURRENT IMAGE THAT IS NOT 
OVERLAPPED BY THE REFERENCE OUTLINE 



SET CURRENT IMAGE TO NOT BE 
INVISIBLE IN THE DETERMINED SECTION 



r 



224 



SET 
REFERENCE 
TO NEXT 
IMAGE 
AFTER 
REFERENCE 
IMAGE 



ANY MORE 
IMAGES AFTER REFERENCE IMAGE 
BUT BEFORE CURRENT 
IMAGE ? 

NO 



DETERMINE MASKING VALUE FOR EACH PIXEL 
OF CURRENT IMAGE BASED ON VISIBLE AREA 
OF IMAGE AND PROXIMITY TO DIVIDING LINES 



ANY MORE 
IMAGES AFTER CURRENT 
IMAGE? 

NO 



228 



230 



226 



YES 



OVERLAP IMAGES BASED ON MASKING 
VALUES TO CREATE A PANORAMIC IMAGE 



• C DONE ) 
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CREATE EMPTY "POSITIONED LIST" STRUCTURE FOR 
STORING IMAGES WHOSE RELATIVE POSITION IS KNOWN 



NO 



( DONE ) 



CHECK IF 
THERE IS AN UNPOSITIONED^ 
J MAGE?. 

YES 

"CHECKF" 
POSITIONED LIST IS EMPTY. 

9 



704 



706 



YES 



NO 



710 



702 



- (FROM 774 (FIG 5B)) 



708 



ADD 
UNPOSTIONED 
IMAGE TO 
POSITIONED LIST 



CREATE EMPTY "OVERLAP LIST' FOR STORING IMAGES IN 
POSITIONED LIST THAT OVERLAP THE UNPOSITIONED IMAGE 



SET: 

BESTjCONFIDENCE = 0 
BESTjCONFIDENCEJMAGE = NO_MATCH 
CURRENT! MAG E = FIRST IMAGE IN POSITIONED LIST 



772 



714 



DETERMINE OFFSET OF UNPOSITIONED 
IMAGE RELATIVE TO CURRENT IMAGE AND 
A CONFIDENCE VALUE FOR THE OFFSET 



716 



CHECK 

IF CONFIDENCE VALUE > A THRESHOLD 
VAL UE 

"yes r~ 



718 



ADD CURRENT IMAGE, THE OFFSET, AND THE 
CONFIDENCE VALUE TO THE OVERLAP LIST 



SET: 

BEST_CONFIDENCE = CONFIDENCE VALUE 
BEST CONFIDENCE IMAGE = CURRENTJMAGE 



CHECK 

IF CURRENT IMAGE IS LAST IN 
POSITIONED LIST ? 



724 



YES 



728 



FIG.. 5 A 



SET REFERENCE 
IMAGE TO FIRST IMAGE 
IN OVERLAP LIST 



1Z1 



726 



SET CURRENT 
IMAGE TO 
NEXT IMAGE 
IN POSITIONED 
LIST 



NO 




NO 



- C GO TO 750 (FIG 5B) j 
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(FROM 728 (FIG 5A)) 



CHECK IF 
REFERENCE IMAGE IS LAST IMAGE 
JN OVERLAP LIST 

no r~ 



750 



YES 



751 



SET CURRENT IMAGE = NEXT IMAGE AFTER 
REFERENCE IMAGE IN OVERLAP LIST 



YES 



CHECK IF 
"ADJACENT LISTS INDICATE THAT" 
CURRENT IMAGE IS CONNECTED TO 
REFERENCE IMAGE 

9 



752 



NO 



754 



TRANSLATE CURRENT IMAGE AND ALL IMAGES 
CONNECTED TO IT RELATIVE TO THE REFERENCE 
IMAGE BASED ON THE OFFSETS OF THE REFERENCE 
AND CURRENT IMAGE TO THE UNPOSITIONED IMAGE 



APPEND THE UNPOSITIONED IMAGE AND THE 
-VE OF THE OFFSET OF THE CURRENT IMAGE 
RELATIVE TO THE UNPOSITIONED IMAGE TO 
THE ADJACENT LIST OF THE CURRENT IMAGE 



760 



SET 
CURRENT = 
NEXT IMAGE 
AFTER 
CURRENT 
IMAGE IN 
OVERLAP 
LIST 



V 



756 




APPEND THE UNPOSITIONED IMAGE AND THE 
-VE OF THE OFFSET OF THE REFERENCE IMAGE 

RELATIVE TO THE UNPOSITIONED IMAGE TO 
THE ADJACENT LIST OF THE REFERENCE IMAGE 




r 



766 



SET 
REFERENCE 
= NEXT IMAGE 

AFTER 
REFERENCE 
IMAGE IN 
OVERLAP 
LIST 



770 



TRANSLATE UNPOSITIONED IMAGE RELATIVE BEST_CONFIDENCE_ 
IMAGE BASED ON THE OFFSET OF THE BEST CONFIDENCEJMAGE 



JL 



APPEND IMAGES IN OVERLAP LIST AND THEIR OFFSETS 
TO THE ADJACENT LIST OF THE UNPOSITIONED IMAGE 



FIG.SB 



ADD UNPOSITIONED IMAGE 
TO THE POSITIONED LIST 
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772 



GO TO 704 (FIG 5A) ) 
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DETERMINE CENTERMOST IMAGE 
BASED ON RELATIVE POSITIONS 



I 



802 



CREATE LIST OF CORRECTED IMAGES THAT 
INCLUDES ONLY THE CENTERMOST IMAGE 



804 



CREATE LIST OF UNCORRECTED IMAGES THAT INCLUDES 
EVERY IMAGE EXCEPT THE CENTERMOST IMAGE 



I 



INITIALIZE BY SETTING: 
MAX_OVERLAP_AREA = 0 
SELECTED_WARPED_IMAGE = UNDEFINED 
SELECTEDJJNWARPEDJMAGE = UNDEFINED 



806 



808 



SET: 

CURRENT_WARPED = FIRST IN IMAGE IN CORRECTED LIST 
CURRENTUNWARPED = FIRST IMAGE IN UNCORRECTED LIST 



I 



810 



812 



COMPUTE OVERLAP AREA BETWEEN 
CURRENT_WARPED AND CURRENTJJNWARPED 



814 



NO 



CHECK IF 

OVERLAP AREA > MAX_OVERI_AP_AREA 

9 



YES 



z: 



816 



CHANGE SELECTED IMAGES BY SETTING: 
MAX_OVERLAP_AREA = OVERLAP AREA 
SELECTED J/VARPEDJMAGE = CURRENT WARPED 
SELECTED_UNWARPED_IMAGE = CURRENTJJNWARPED 



r 



820 



SET 
CURRENT_ 
WARPED = 
NEXT IMAGE 

IN LIST OF 
CORRECTED 
IMAGES 



YES 




CORRECT THE PERSPECTIVE OF SELECTED. 
UNWARPED RELATIVE TO SELECTED_WARPED 
BASED ON THEIR RELATIVE POSITIONS 



I 



830 



r 



824 



SET: 
CURRENT. 
UNWARPED = 
NEXT IMAGE 
IN LIST OF UN- 
CORRECTED 

IMAGES 
CURRENT. 
WARPED = 
FIRST IMAGE 

IN LIST OF 
CORRECTED 
IMAGES 



MOVE CURRENTJJNWARPED IMAGE FROM LIST OF 
UNCORRECTED IMAGES TO LIST OF CORRECTED IMAGES 



l— C DONE ) 

FIG. .6 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 
J^'FADED TEXT OR DRAWING 
^BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



